SEMI-STABLE LOCUS OF A GROUP 
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Abstract. In this paper, we consider the diagonal action of a 
connected semisimple group of adjoint type on its wonderful com- 
pactification. We show that the semi-stable locus is a union of the 
G-stable pieces and we calculate the geometric quotient. 



0.1. Introduction. Let G be a connected, semisimple algebraic group 
of adjoint type over an algebraically closed field and X be its wonderful 
compactification. We will give an explicit description of the semi-stable 
locus of X (for the diagonal G-action) using Lusztig's G-stable pieces 
and calculate the geometric quotient X/ / G. We also deal with the case 
where the G-action is twisted by a diagram automorphism. 

The results will be used by the first author [He] to study character 
sheaves on the wonderful compactification. 

During the time the article was writing, we learned that De Concini, 
Kanna and Maffei [CKM] described the semi-stable locus and geometric 
quotient for complete symmetric varieties (which includes as a special 
case the non-twisted conjugation action of G on its wonderful compact- 
ification). 

0.2. Geometric invariant theory. The foundations of geometric in- 
variant theory are developed in [MFK94j . We quickly review that part 
which we use. Let k be a field. The setup for geometric invariant 
theory over k consists of (G, X, r, &, ip) where 

(i) G is a reductive algebraic group over k, 

(ii) X is a separated, finite type /c-scheme, 

(iii) r : G x X —>■ X is an algebraic action of G on X, 

(iv) £ is an invertible sheaf on X, and 

(v) ip : t*L — > pr^£ is a G -linearization of L (where pr x : GxX — > 
X is the projection), i.e., an isomorphism of invertible sheaves 
on G x X which defines a lifting of the action r to an action of 
G on Spec x Sym*(£). 

The fundamental theorem of geometric invariant theory, [MFK94, 
Theorem 1.10, p. 38], associates to this datum a pair (X ss (£), 0). Here 
X SS (L) is the union X s over all positive integers n and all G- invariant 



X. H. was partially supported by (USA) NSF grant DMS 0700589 and (HK) 
RGC grant DAG08/09.SC03. J. S. was partially supported by an Alfred P. Sloan 
fellowship, NSF grant DMS-0553921 and NSF grant DMS-0758521. 

1 



2 



XUHUA HE AND JASON STARR 



sections s of T(X, £® n ), provided X s is affine (recall, X s is defined to be 
the maximal open subscheme of X on which s is a generator of L® n ). 
And is a G-invariant fc-morphism 

: X SS (L) -> X/^G 

which is a uniform categorical quotient of the action of G on X SS (X). 
Moreover the following hold. 

(i) The morphism is affine and universally submersive. 

(ii) For some integer n > 0, there exists an ample invertible sheaf M 
on Xj I jc,G such that 0*M is isomorphic to £® n as G-linearized 
invertible sheaves (in particular, X//&G is quasi-projective). 

(hi) There exists a unique open subscheme U of Xj / &G such that 
(j)~ l (U) is the stable locus. And the induced morphism : 
(f)~ l {U) — > £/" is a uniform geometric quotient of 0~ 1 (£7). 

Since we do not make use of them, we will not make precise the 
definitions of uniform categorical quotient, stable locus and uniform 
geometric quotient. But we will use a few other known facts about 
geometric invariant theory. 

Fact 1. When X is projective and L is ample, every open X s is affine. 
Thus Xj I ' jjG is canonically isomorphic to 

X//^G = Proj ®n>oT(X,H® n f 

and X ss (£j) is the maximal open subscheme of X on which the natural 
rational map from X to Xj / &G is defined, |Ses77j . 

Fact 2. Again when X is proper, every G-orbit O in X ss (£j) contains 
a unique closed G-orbit in its closure (in X SS (L)). And two G-orbits 
0\ and O2 in X SS (L) are in the same fiber of if and only if the 
associated closed G-orbits are equals. In particular, establishes a 
natural bijection between the points of Xj / &G and the closed G-orbits 
in X ss (£), jSesTTj . 

Fact 3.(Matsushima's criterion) A G-orbit O is affine if and only if the 
stabilizer group of one (and hence every) closed point is itself reductive, 
[Ric77] . In particular, since the fibers of are affine, every closed G- 
orbit in X SS (L) is affine, and hence has reductive stabilizer group. 

Fact 4. If X is normal (or if X SS (JL) is normal), then factors through 
the normalization of the target. Thus by the universal property , the 
target Xj / &G is normal. 

0.3. Notations. Now we fix the notations used in the rest of this ar- 
ticle. Let G be a connected semisimple algebraic group of adjoint type 
over an algebraically closed field k. Let B be a Borel subgroup of G, 
B~ be an opposite Borel subgroup and T = B fl B~ . Let (aj)j e j be 
the set of simple roots determined by (B,T). We denote by W the 
Weyl group N(T)/T. For w G W, we choose a representative w in 
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N(T). For i G I, we denote by 0j and s, the fundamental weight and 
the simple reflection corresponding to aj. 

For J <Z I, let Pj D B be the standard parabolic subgroup defined 
by J and let Pj D P~ be the parabolic subgroup opposite to Pj. 
Set Lj = Pj H PJ . Then Lj is a Levi subgroup of Pj and Pj~. The 
semisimple quotient of Lj of adjoint type will be denoted by Gj. We 
denote by tc Pj (resp. n p -) the projection of Pj (resp. Pj~) onto Gj. 

Let PVj be the subgroup of W generated by {sj \ j G J} and iy J be 
the set of minimal length coset representatives of W/Wj. 

0.4. Wonderful compactification of G. We consider GasaGxG- 
variety by left and right translation. Then there exists a canonical 
G x G-equivariant embedding X of G which is called the wonderful 
compactification ( [DCP83] . [Str87] ). The variety X is an irreducible, 
smooth projective (G x G)-variety with finitely many G x G-orbits Zj 
indexed by the subsets J of I. The boundary X — G is a union of 
smooth divisors Zi-.u\ (for i & I), with normal crossing. The G x G- 
variety Zj is isomorphic to the product (G x G) x p - xPj Gj, where 

Pj x Pj acts on G x G by ■ (#1,3-2) = (g 1 qi,g 2 pi) and on Gj by 
(q,p) ■ z = 7T P j(q)z7Tpj(p)i. We denote by hj the image of (1, 1, 1) in 
Zj under this isomorphism. 

0.5. Twisted actions. We follow the approach in |HT06t Section 3]. 
Let a be an automorphism on G such that cr(B) = B and cx(T) = T. 
We also assume that a is a diagram automorphism, i.e., the order of a 
coincides with the order of the associated permutation on /. 

Let G a (resp. X a ) be the (G x G)-variety which as a variety is 
isomorphic to G (resp. X), but the G x G-action is twisted by (g, g') 1— > 
(g, o~(g')). Then G CT is an open G x G-subvariety of X a and we call X a 
the wonderful compactification of G a . 

Under the natural bijection between X and X a , we may identify the 
G x G-orbits on X with the G x G-orbits on X a . We denote by Zj a 
the G x G-orbit on X a that corresponds to Z c ij\ C X. Accordingly, 
we denote by /ij j(T the base point in Zj^ a which corresponds to the base 
point h a (j) of Z CT( j). 

0.6. a-semisimple elements in G CT . We follow the notation of |Spr06| . 
An element g G G CT is called a-semisimple if it is conjugated to an ele- 
ment in T. We have the following result. 

Theorem 0.1. Let g G G a . Then the following conditions are equiva- 
lent: 

(1) The element g is a-semisimple. 

(2) The G-orbit of g is closed in G a . 

In this case, the isotropy subgroup of g in G is reductive. 
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The equivalence of (1) and (2) can be found in |Lus03l 1.4 (e)] (in 
terms of disconnected groups instead of twisted conjugation action). In 
the case of simply connected group, the equivalence is also proved in 
|Spr06 Proposition 3]. By Fact 3, Matsushima's criterion, the G-orbit 



of g is closed implies that the isotropy subgroup of g is reductive. 

0.7. G-stable-piece decomposition. Let Ga be the diagonal image 
of G in G x G. The classification of the GA-orbits on X was obtained 
by Lusztig |Lus04] in terms of G-stable pieces. A similar result also 
occurs in |EL0 6]. We list some known results which will be used later. 
For J C I and w G W a{ J \ set 

Zj^- W = Ga(Bw, B) ■ h J>a . 

We call Zj^. w a G-stable piece of X a . By |Lus04l 12.3] and [He06l 
Proposition 2.6], X a is a disjoint union of the G-stable pieces. 

Fact 5. X a = Ujc/ LLgwM- 7 ) Zj, a ;w 

Set I(J,cr;w) = m&x{K C J \ wa(K) = K}. Then the subvariety 
Li(j, a -w)W of G a is stable under the action of x Lj^.^ and in 

particular, is stable under the conjugation action of Lj^ J>(7 . w y Moreover, 
by |Lus04l 12.3(a)] and jHeOTl Lemma 1.4], 

Zj,(t;w = G a{Li(J^;w)W, 1) • tlj^ 

and there exists a natural bijection between the GA-orbits on Zj t(T . w 
and the L/(j jCT;w )-orbits on L I (j^. w * ) w/Z°(Lj) C G a /Z°(Lj) (for the 
conjugation action of -^/(j i<T;t0 )). 

For any point z in Zj^ a;w , the isotropy subgroup 

G z = {g E G | (g,g) ■ z = z} 

was described explicitly in [EL06, Theorem 3.13]. We only need the 
following special case in our paper. 

Fact 6. Let z = (glw,g) ■ h Ja for g 6 G and / G L^j^ w y Then G z 
is reductive if and only if w — 1 and / is a a-semisimple element in 

Ll(J,o;l)- 

By |He07t Theorem 4.5], the closure of each G-stable piece is a union 
of G-stable pieces and the closure relation can be described explicitly. 
More precisely, for J C /, w G W a ^ and w' G W, we write w' ^j j(7 w 
if there exists u G Wj such that w' ^ uwa{u)i. Then 



Zj, a -w — Uj/ c j \-l w > e w J ',w% J>a w Zj',a;w'- 

Notice that if 1 w, then we must have w — 1. Therefore, 



Fact 7. U JcI Zj^.i is open in X a . 
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0.8. Nilpotent Cone of X. For any dominant weight Z, let H(Z) be 
the dual Weyl module for G sc with lowest weight —I. Let CT H(Z) be 
the G sc -module which as a vector space is H(/), but the G sc -action 
is twisted by the automorphism a on G sc . Then there exists (up to 
a nonzero constant) a unique G sc isomorphism CT H(Z) — > H(cr(/)). In 
particular, if I = or (I), then we have an isomorphism // : CT H(Z) — > H(Z). 
By |DCS99l 3.9], there exists a G x G-equivariant morphism 

Pl : X - P(End(H(0)) 

which extends the morphism G CT — > P(End(H(Z))J defined by ^ i — > 
(7 [Id;] , where [Id;] denotes the class representing the identity map on 
H(Z) and g acts by the left action. We denote by £x(A) the G sc x G sc - 
linearized invertible sheaf on X which is the pullback under p\oi 0(1) 
with its canonical linearization. This is the "usual" linearized invertible 
sheaf on X associated to the weight A, e.g., as defined in [BP001 p. 100]. 
For sufficiently divisible and positive n, the G sc x G sc -linearization of 
<Cx(A)® n = &x{n ■ A) factors through a G x G-linearization. This 
induces a GA-linearization of £jx(ty® n - If moreover, A is regular, then 
£x(A) is ample (see |Str87l section 2]). 

The morphism pi induces a G x G-equivariant morphism X a — > 
P(Hom( CT H(/), H(/))) . When I = a (I), we may apply the isomorphism 
fi : <T H(/) — > H(Z) to obtain the G x G-equivariant morphism 

:X ff ->P(End(H(0)). 

As above, £x CT (A, cr) denotes the G sc x G sc -linearized invertible sheaf on 
X a which is the pullback under p\ j(7 of 0(1) with its canonical lineariza- 
tion. Of course X a equals X as varieties, and £x(A) equals £x CT (A,er) 
as invertible sheaves on this variety. But the G x G-actions are not 
the same, and thus the G x G-linearized invertible sheaves are not the 
same. 

For I = a (I), let N(/) CT be the subvariety of X a consisting of elements 
that may be represented by a nilpotent endomorphism of H(Z). We 
call N(Z) CT the nilpotent cone of Xi associated to the dominant weight Z. 
We have an explicit description of N(Z) which was obtained in |HT06l 
Proposition 4.4] 

= U U Z ^ 

i(i)nsupp(w)=£0 

where 1(1) = {i G / | a, ^ 0} of / for Z = J2i^i a i^i an d supp(w) C / 
is the set of simple roots whose associated simple reflections occur in 
some (or equivalently, any) reduced decomposition of w. 

Two subvarieties of X related to the nilpotent cones of X are of 
special interest. One is 

H; is dommantN(Z)o- = Uj c _f \A w( z W a(.J) )S upp(w)=I Z.J,a;w 
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This subvariety is actually the boudary of the closure in X a of unipotent 
subvariety of G a in the case where G is simple (See |He06t Theorem 
4.3] and [HTM Theorem 7.3]). 

The other one is X a - U ns dominant^)* = U Jc/ Z Ji(j;1 , which is the 
complement of N(Z)o- for any a-stable dominant regular weight. By the 
next theorem, this subvariety is actually the semi-stable locus of X a 
for the GA-action. 

Theorem 0.2. For A as above, i.e., a -stable, dominant and regular, 
the semistable locus (X a ) ss (L x (\)® n ) equals Uj c /Zj i(7;1 . In particular, 
the semistable locus is independent of the choice of weight A. 



Proof. We simply write the semistable locus (X a ) ss (Lx(\)® n ) as X* B . 
On End(iJ(A)) the characteristic polynomial map 



is a morphism which is invariant under the conjugation action. The co- 
efficients of the characteristic polynomial define homogeneous polyno- 
mials on End(if(A)) which are invariant under the conjugation action. 
Also the degree is positive except for the leading coefficient (which is 
1). Thus each non- leading coefficient defines a GA-mvariant sections 
of positive power 0(n) on P(End(if (A))). The pullbacks of these sec- 
tions are GA-invariant sections of positive powers L® n . By Fact 1, 
the nonvanishing locus of each of these sections is in the semistable lo- 
cus. Equivalently, the non-semistable locus is contained in the common 
zero locus of all of these sections. But the common zero locus of these 
pullback sections on X a equals the inverse image of the common zero 
locus of the original sections on P(End(if (A))). And this common zero 
locus is precisely the nilpotent cone in P(End(if (A))). Thus the non- 
semistable locus is contained in Jn!"(A) ct . So X* s contains X a — ^(A)^, 
i.e., X* s contains Uj c /Zj j(J; i. 

Also, by Fact 7, X° s -Uj^Zj^x is closed in X° s . If X s a s strictly 
contains Uj c /Zj )Cri i, then there exists a closed GA-orbit in X^ s that is 
not contained in Uj c /Zj jCr;1 . Let z be an element in that orbit. By 
Fact 3 above, the isotropy subgroup of z, {g G G \ (g,g) • z — z}, is 
reductive. By Fact 5 above, z is in Zj >(T . w for some J C I and w 6 W a ^ 
with w^l. But this contradicts Fact 6 above. Therefore X^ s equals 



In the rest of this paper, we will describe the geometric quotient 
Xj /G. The description of the geometric quotient for the twisted action 
is based on some detailed analysis on the structure of the semi-stable 
locus and will be included in a future article. 

Lemma 0.3. A G^-orbit in X ss is closed in X ss if and only if it 
intersects T. 



X : End(tf (A)) - k[t] 



(/ : H(X) - H(X)) » Xfit) 



UjClZj,a;l- 



□ 
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Proof. By |BK05l Lemma 6.1.6 (ii)], T = U JcI N{T) A ■ (T, 1) • hj. Let 
z G X ss such that Ga ■ z is closed in X ss . Then Ga ■ z is affine and G z 
is reductive. By Fact 6, z is of the form {(gl, g) ■ hj \ g G G} for some 
semisimple element / G Lj. Hence / is conjugate to an element in T. 
Therefore G A ■ z n f ^ 0. 

On the other hand, if z G T, then the isotropy subgroup of z in G 
contains T. Let O be the unique closed G-orbit that is contained in 
the closure of Ga • z. Then Ga ■ z and O lie in the same fiber of <p, 
which is an affine variety. By |Ste74t Page 70, Corollary 1], Ga • z is 
closed in that fiber. Hence Ta ■ z — O. □ 

Lemma 0.4. For every element z in T , the intersection Ga • z D T of 
the G-orbit with T equals the N(T)- orbit N(T)a ■ z. 

Proof. Obviously N(T)a ■ z is contained in Ga • z D T. The content of 
the lemma is the opposite inclusion. 

We may assume without loss of generality that z has the form z = 
(t, 1) • hj. Suppose that (g, g) ■ z equals (t', 1) • hj for some t' G T, i.e., 
(g, g) ■ z is a point of Ga • z fl (T, 1) • hj. 

Let Fj = (Pj, Pj)-hj, then by |He07t Proposition 1.10], the action of 
G on X induces an isomorphism of Zj^ with Gxp d Fj. Thus g is in Pj. 
Also both t and t' are contained in the same Pj-orbit in Lj/Z°(Lj), 
i.e. in the same Gj-conjugacy class. Hence there exists an element n 
in N{T) such that t! equals ntni. Therefore Ga • z H (T, 1) • is a 
subset of N(T)a ■ z. Now also 

G A ■ z n T = G A • z n N(T) A (T, 1) ■ hj = N(T) A -(G A -zn (T, 1) ■ /ij) 
C N(T) A ■ ((N(T) A ■ z) = N(T) A ■ z 

proving the lemma. □ 

Corollary 0.5. The embedding T — > X a induces an isomorphism 

i : f/W -> X//G. 

Proof. Notice that T/N(T) equals T/W for the natural H^-action on 
T which extends the H^-action on T. 

The morphism T — > X — > Xj /G is A^(T)-invariant, and hence factors 
through a morphism 

i : f/W -> X//G. 

By Lemma 10.31 every closed G-orbit in X ss intersects T. Thus i is 
surjective. For every element z in T, the G-orbit of z is closed in X ss . 
Thus two elements z, z' in T have the same image under i if and only 
if they lie in the same G-orbit. On the other hand, by Lemma ICT4"l two 
elements z, z' in T lie in the same G-orbit if and only if they lie in the 
same iV(T)-orbit. Hence % is a bijection on points. 

By |Ste65l section 6], the restriction of % to the open subvariety T/W 
of T/W gives an isomorphism T/W = G//G. Hence, as above, i is 
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a bijective, birational morphism of varieties whose target is a normal 
variety. So again by Zariski's Main Theorem, % is an isomorphism. □ 
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